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Abstract 

In this paper, we continue our study on a general time-inconsistent stochastic 
linear-quadratic (LQ) control problem originally formulated in [6]. We derive a 
necessary and sufficient condition for equilibrium controls via a flow of forward- 
backward stochastic differential equations. When the state is one dimensional and 
the coefficients in the problem are all deterministic, we prove that the explicit equi¬ 
librium control constructed in P is indeed unique. Our proof is based on the derived 
equivalent condition for equilibria as well as a stochastic version of the Lebesgue 
differentiation theorem. Finally, we show that the equilibrium strategy is unique for 
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a mean-variance portfolio selection model in a complete financial market where the 
risk-free rate is a deterministic function of time but all the other market parameters 
are possibly stochastic processes. 

Key words, time-inconsistency, stochastic linear-quadratic control, uniqueness of 
equilibrium control, forward-backward stochastic differential equation, mean-variance port¬ 
folio selection. 
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1 Introduction 

Time inconsistency in dynamic decision making is often observed in social systems and 
daily life. The study on time inconsistency by economists dates back to Strotz [9] in the 
1950s, who proposed the formulation of a time-inconsistent decision problem as a game 
between incarnations of the controller at different time instants. 

The game formulation is fairly straightforward and easy to understand when the time 
setting is discrete. In a continuous-time setup, the formulation can be generalized in dif¬ 
ferent ways. Yong m and Ekeland and Pirvu [5] dehne equilibrium controls in the class 
of feedback policies for problems involving hyperbolic discounting, and prove the existence 
of equilibria. Grenadier and Wang |1] investigate optimal stopping with, again, hyperbolic 
discounting. Bjork and Murgoci [1] formulate a general Markovian stochastic control prob¬ 
lem with time inconsistent terms, and establish sufficient conditions for equilibria through 
a generalized HJB equation system. They then present some special cases including a 
linear-quadratic (LQ) control problem in which solutions are constructed. Bjork, Mur¬ 
goci and Zhou [2] further derive analytically an equilibrium strategy for a mean-variance 
portfolio selection model with state-dependent risk aversion. 

In our previous paper, |6] , we formulate a general non-Markovian stochastic LQ control 
problem, where the objective functional includes terms leading to time-inconsistency, and 
derive a general sufficient condition for equilibria through a system of forward-backward 
stochastic differential equations (FBSDEs). Based on this condition, we construct explicitly 
an equilibrium control when the state is scalar-valued and all the coefficients are non- 
random. In contrast to the aforementioned works where an equilibrium control is dehned 
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within the class of feedback controls, we define our equilibrium via open-loop controls. 

Most of the existing literature on game formulation of time-inconsistent problems has 
focused on existence of equilibria, and the only paper according to our best knowledge that 
mentions about the uniqueness is Vieille and Weibull [10] , in which the authors show that 
the uniqueness does not hold in a discrete-time model. Uniqueness is important in both 
practice and theory. In applications, multiple equilibria lead to multiple value processes 
and there is an issue of the choice of the one to use and implement. Theoretically speaking, 
when a new, weak notion of a solution is introduced the uniqueness is always important, for 
it is one of the touchstones of the appropriateness of the new dehnition (non-uniqueness is 
a sign that the notion may be too weak to be useful). On the other hand, mathematically, 
proving uniqueness of a weaker notion is almost always challenging^ 

In this paper, we take on the challenge of establishing the uniqueness of equilibrium 
control for the same time-inconsistent model formulated in [B]. First, we derive a general 
necessary and sufficient condition for equilibrium controls. A key step in the derivation is 
to prove a stochastic version of the Lebesgue differentiation theorem which is interesting in 
its own right and potentially useful for other stochastic control problems. Then, we focus 
on the case in which the state is one dimensional and the coefficients in the problem are 
all deterministic. Thanks to the derived equivalent condition for equilibria we show that 
the explicit equilibrium control constructed in [6] is indeed unique. Finally, we prove that 
the equilibrium strategy, again constructed in [B], is unique for a mean-variance portfolio 
selection model in a complete financial market where the risk-free rate is a deterministic 
function of time but all the other market parameters are possibly stochastic processes. 

The rest of this paper is organized as follows. In Section [2l we recall the formulation of 
the time-inconsistent LQ control problem studied in our previous work [B]. We then derive 
an equivalent characterization of equilibrium controls in terms of the solution to a system 
of FBSDEs in Section [3l In Section |4] we prove that the equilibrium obtained in [6] is the 
unique one. Section |B] is devoted to the uniqueness for a mean-variance portfolio selection 
model. Finally, Section |B] concludes. Some technical derivations are placed in appendices. 


^The value of an equilibrium control is the corresponding objective functional value, 
good example is the uniqueness of viscosity solution for a nonlinear PDE; see [12] 
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2 Problem Formulation 


Let (VLt)o<t<T = (Wt 1 ■ ■ ■ ) W^/)o<t<T be a d-dimensional Brownian motion on a probability 
space (fi, P). Denote by {J^t) the angmented filtration generated by (Wt). 

We will use the same notation as in our previous paper [6], which we list here for the 
reader’s convenience: 



the set of symmetric 1 x 1 real matrices. 

L2(D; 

the set of random variables y, : (D, Q) (M^, 

with E [ < -|-cx). 


the set of essentially bounded random variables 

Ll{t, T; Wy. 

the set of {^s}se[t,T]-adapted processes 

/ = {fs ■ t < s < T} with E Ifs^ ds < oo. 

L^{t, T- wy 

the set of essentially bounded {^s} 5 g[ 4 ^'r]-adapted processes. 

Li{n- C{t, T; Ryy 

the set of continuous {^t}sG[t,T]-adapted processes 

f = {fs ■ t < s <T} with E [sup^gfir] l/^n < oo- 


We will often use vectors and matrices in this paper, where all vectors are column 
vectors. For a matrix M, dehne 

M': transpose of a matrix M. 

1^1 ~ Frobenius norm of a matrix M. 

The time-inconsistent LQ control model under consideration in this paper was intro¬ 
duced in [6]. Here we recall the formulation. 
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Let T > 0 be given and fixed. The controlled system is governed by the following 
stochastic differential eqnation (SDE) on [0,T]: 

d 

(2.1) dX, = + B'^us + K]ds + + Dlus + aijdW^- Xq = Xq, 

i=i 

where A is a bonnded deterministic fnnction on [0, T] with valne in B,C^, are all 

essentially bonnded adapted processes on [0,T] with valnes in respec¬ 

tively, and b and are stochastic processes in L^(0,T;M"). The process M e L^(0, T; M') 
is the control, and X G C(0, T; M"')) is the corresponding state process with initial 

valne Xq G M"". 

When time evolves to t G [0,T], we need to consider the controlled system starting 
from t and state Xt G M"'): 

d 

(2.2) dXs = + b,]ds + J2[CiX, + Dius + (Tl]dWl, X, = Xf 

i=i 

For any control M G L^(t,T;M'), there exists anniqne solntion G T^(f2; C(t,T;M”)). 

At t with the system state Xt = Xt, onr aim is to minimize 

1 1 
J{t,xt]u) = 2 ^t [{QsXs,Xs) + {RsUs,Us)]ds +-Et[{GXT,XT)] 

(2.3) --{hEt [Xt] ,IE( [Xt]) — (pi^t -|- 1 x 2 , Et [X^]) 

over u G T3r(t, T; M^), where X = and Ef [•] = E [■\Xt\- In the above Q and R are 

both positive semi-definite and essentially bonnded adapted processes on [0,T] with valnes 
in S" and respectively, G,h, pi,/i 2 are constants in §"■, S", M"" respectively, and 

moreover G is positive semi-definite. 

We define an equilibrium (control) in the following manner. Given a control n*, for any 
f G [0,T), £ > 0 and v G W), define 

(2.4) = ul + vls^[rt+e), sG[f,T]. 


Definition 2.1 Let u* G T^(0, T; M^) he a given control and X* be the state process 
corresponding to u*. The control u* is called an equilibrium if 

hminf At,X:-,u^^^’'^)-J{t,X:;u*) ^ 

£ 4,0 £ 

where is defined by ^2.4\ ), for any t G [0,T) and v G L‘)rfiLl; M)). 
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Notice that here we have changed lim in [6] to liminf in this dehnition, resulting in a 
weaker dehnition. As a result, the sufficient condition derived in [6] is also sufficient for 
this new dehnition. On the other hand, the uniqueness result to be established for the 
new dehnition will also imply the uniqueness for the old one. For these reasons, the above 
dehnition appears to be more appropriate. 

3 Necessary and Sufficient Condition of Equilibrium 
Controls 

In our previous paper, [6], a sufficient condition is derived via the second-order expansion in 
the local spike variation, in the same spirit of proving the stochastic Pontryagin’s maximum 
principle [3 El 112] • In this section, we present a general necessary and sufficient condition 
for equilibria. This condition is made possible by a stochastic Lebesgue diherentiation 
theorem involving conditional expectation. The latter theorem, interesting in its own 
right, is new according to our best knowledge. 

To proceed, we start with some relevant known result from our previous paper [6] . Let 
u* be a hxed control and X* be the corresponding state process. For any t G [0, T), dehne in 


the time interval [t, T] the processes (p(-; t), (/c-^(-; t))j=i,...,d) ^ L‘jr{t,T] M"') x 
as the unique solution to 





(3,1) 




p(T; t) = GX; 


T 


hEif [X^] — jJ-iX* — /i2. 


V 


Furthermore, dehne ^d) £ x T; as the 
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unique solution to 


dP{s; t) = -|74'P(s; t) + P(s; t)As 


(3.2) 


+ t)ci + {Ci)'KHs-, t) + KHs-, (jQ] + Q.]ds 

+ E"=i ‘MW';. se[‘.r]. 


P{T-t)= G. 


The following estimate under local spike variation is reproduced from [6l Proposition 


3.1], 


Proposition 3.1 For any t E [0,T), e > 0 and v E KO; define by l\2.4\ ). 

Then 


where A{s;t) = Bsp{s;t)+Y,'^j^fiDiyy{s;t)+RsU* andH{s;t) = P{s;t)Di. 

In view of Proposition 13.11 and the fact that P(s; t) P 0, it is straightforward to get the 
following characterization of an equilibrium. 

Corollary 3.2 A control u* G L^(0,T, M*) is an equilibrium if and only if 

1 

(3.4) lim- / [A(s; t)] ds = 0, a.s., VtG[0,T). 

£ 4.0 £ Jt 

The next result provides a key property for the solution to the BSDE fl3.ip . and repre¬ 
sents the process A(s;t) in a special form. 


(A(s; t),v) + 2 + oR) 


Proposition 3.3 For any given pair of state and control processes {X*,u*), the solution 
to / Id. 1\) satisfies k{s-,ti) = k{s;t 2 ) for a.e. s > max(ti,t 2 )- Moreover, there exist Ai G 
L3r(0, T; M^), A 2 G L“(0, T; M*^"") and f E L‘^{kl;C{0,T;MA)), such that A{s;t) has the 
representation 


A(s; t) — Ai(s) -|- A 2 (s)^t. 
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Proof: Define the function '0(-) as the unique solution for the matrix-valued ordinary 
differential equation (ODE) 

d^jit) = 'tp{f)A{t)'dt, ii{T) = In, 


where In denotes the nxn identity matrix. It is clear that is invertible, and both '0(-) 
and bounded. 

Let p{s-,t) = tjj{s)p{s-,t) + hKt [Xf.] + piXf + p 2 and k^{s-,t) = tjj{s)k^{s-,t) for j = 
1, • • • ,d. Then on the interval [t, T], (p(-; t), k{-; t)) satishes 
(3.5) 


dp{s;t) = - E 7 =iV'(s)(C'^)V(s) ^k^{s;t) + 'i/j{s)QsX; ds+ ^.-^k^{s;t)dW^, 


p{T-1) = GX^. 


Notice that neither the terminal condition nor the coefficients of this equation depend on 
t] so it can be taken as a BSDE on the entire time interval [0,T]. Denote its solution 
as {p{s),k{s)), s G [0,T]. It then follows from the uniqueness of the solution to BSDE 
that {p{s]t),k{s]t)) = {p{s),k{s)) at s G [t,T] for any t G [0,T]. As a result, k{s]t) = 
'ijj{s)~^k{s) := k{s), proving the hrst claim of the proposition. 

Next, 


p(s;t)='0(s) ^p(s)-'0(s) \hEt[XT]+piX; + P 2 ) = P{s)+i:{s) 

where ft '■= —hEt [X^] — piXf — p 2 dehnes the process f G Ljr{Q] C{0,T] M”)) and p{s) := 
'0(s)“^p(s) dehnes the process p G L^(D; (7(0, T; M")). Consequently, 

d 

A{s-,t) = Bsp{s-,t)+ '^{Diyk^{s-,t) + R,ul 

i=i 

d 

= B,p{s) + 5^(D^j'fc^(5) + 
i=i 

= Ai(s)-I-A 2 (s)^t, 

where Ai(s) := Bsp{s) + + RsUt and A 2 (s) := Bsil:{s)~^. Q.E.D. 


We now set out to derive our general necessary and sufficient condition for equilibrium 
controls. Although 03.41) already provides a characterizing condition, it is nevertheless not 







very useful because it involves a limit. It is tempting to exj^ct that the limit therein is 
A{t]t), in the spirit of the Lebesgue differentiation theorems However, one needs to be 
very careful since in fl3.4p the conditional expectation with respect to is involved. The 
following general result can be regarded as a stochastic Lebesgue differentiation theorem. 
While it serves our purpose in this paper, it is of interest in its own right and may be 
potentially useful for (among others) various stochastic control problems. 


Lemma 3.4 Let Y G T ; M^) be a given process. If I [W] ds = 0, a.e.t G 

[0,T),a.s., then Yt = 0, a.e.t G [0,T),a.s.. 


Proof: Since is a separable space, it follows from the (deterministic) Lebesgue 

differentiation theorem that there is a countable dense subset V C 
such that for almost all t, we have 


(3.6) 


1 

lim - / E [(W, p)] ds = E [{Yu p)] , Vr; G P, 

£ 4,0 £ 


and lim^^o ^ ft ^ E [Yf] ds = E [Yf]. 

For any ?7 G "D, dehne rjs = E^)//]. Then E [(W, 77)] = E [(W, 77^)]. We have the following 
estimates: 


1 r 

1 / 

lim-/ E[{Y„r],-r]t)]ds 

< hm-W 

£4-0 eJt 

£4-0 e y 



1 1 / -1 pt-\-£ 


< [ E[i; 2 ]ds / sup E[{ris-r]ty] 

HO y E Jt y sG[t,t+e] 


< 2 lim y ^ ^ E \Yf] ds^/E [{pt+e - Ptf] = 0, 
where the last inequality is due to Doob’s martingale inequality as 77 ^ is a square-integrable 


simple version of this theorem states that if ip is an integrable real function on [0,r], then 
lime4,o \ ft'''" (p{s)ds = (p{t) a.e. t € [0,T]. 
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martingale. Hence for any r] eT>, 


E|{y„,„)] = E|(y„,,)i 
1 


= lim - / E [(F^, rj)] ds 

^ Jt 

= lim- / E[{Ys,r]s)]ds 

£>1,0 £ 

= lim- / E[{Ys,r]t)]ds 

£>i-0 £ 

= lim - / E [(Ei [F^] , r]t)] ds 

£4.0 e 

r 1 

= limE (- / Et[Ys]ds,r]t) 
£4-0 E 


Since 



/1 ^ 



E 

-/ Ei[F,]ds 

< E 

/ —ds / Ei [Fs] ds 


Jt ) 


VJt Jt \ 


= ^E 
e 


< 




Ei %fds 




/ E [y/] ds, 

^ Jt 

and limej^o \ E [F^^] ds = E [Y^], there exists a constant 5t > 0, such that 

pt-\-£ 


E 


Ei [n] ds 


<2E[F,2], V£e(0,<5i). 


This implies that ^ ^Ei [F^] ds is uniformly integrable in e G (0, 6t). Hence 


lim E 

e4.0 


1 

rt+e 


e 


Ei [F,] ds 


= E 


lim 

£> 1,0 


f*t-\-£ 


Ei [F,] ds 


= 0 . 


Since 7] is essentially bounded, so is rjt] hence there exists a constant c > 0 such that 


E 


f*t-\-£ 


Ei [Fs] ds, ? 7 i) 


< cE 

—)■ 0 , 


f*t-\-£ 


Ei [F^] ds 


implying 


limE 

£4,0 


,1 


f*t-\-£ 


Ei [Ys] ds, rjt) 


= 0 . 


Thus E [{Yt,rj)] = 0, a.e.t G [0,T] for any rj eV, which implies 

Fi = 0, a.e.t G [0,T], a.s.. 
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Q.E.D. 


We are now in the position to present the main result of this section. 

Theorem 3.5 Given a control u* G L^(0,T;M^), let X* he the corresponding state process 
and (p(-; t),/c(-; t)) G L‘^{t,T-,'MG) x (L3r(t, T; be the unique solution to the BSDE 

l\3.1\) . Then u* is an equilibrium control if and only if 

(3.7) = 0, a.s., a.e. t G [0,T]. 


Proof: Recall that we have the representation A(s;t) = Ai(s) + A 2 (s)^t. Since A 2 is 
essentially bounded and f is continuous, we have 


lim Et 

e4,0 


1 

£ 






6) Ms 


1 

< dim- / Ej[|6-6|]c?s 

etO £ 

= 0 , 


where the last equality is because E([|Cs ~ 6|] is a continuous function of s and vanishes 
at s = t. 

It then follows 

lim- / Et[A(s; f)] ds = lim - / E* [A(s; s)] ds. 
e eto £ 

Now, if fl3.7p holds, then 

lim - / Ef [A(s; t)] ds = lim - / E* [A(s; s)] ds = 0. 

etO £ J t e4-0 £ 

Conversely, if (13.4p holds, then lime 4 ,o “ Ej [A(s; s)] ds = 0, leading to (13.7p by virtue 
of Lemma 13.41 Q.E.D. 


4 Uniqueness When State is One-dimensional and Co¬ 
efficients Are Deterministic 

In our previous paper [6], when the state variable is scalar-valued, i.e., n = 1, and all the 
coefficients are deterministic, an explicit equilibrium is constructed essentially based on 
the equivalent condition (13.7p (although we were not yet able to prove it there). In this 
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section, we will prove that in the same setting the equilibrium is actually unique, thanks 
again to fl3.7p . 

Throughout this section we assume that n = 1 and all the parameters A, B, b, Q 

and R are deterministic function of t. In this case the controlled system reduces to 

(4.1) dXg = + BgUs + bs]ds + [CgXg + DgUg + (7s]'dWs', Xq = xq, 

where 

C := (C\ • • • , C")', D := ((D^)', • • ■ , {D^yy, a := (a\ • • • , a")'. 

Accordingly, the BSDE fld.ip is simplihed to (also noting that k{s;t) = k{s)) 


(4.2) 


dp{s-,t) = - [Asp{s-,t) + C'^k{s) + QsX*]ds + k{sydWs, sG [t,T], 
p{T-1) = GX^ - hEyX*] - p,X: - /i2, 
whereas the corresponding A(s;t) is now in the form 

A(s; t) = Bsp{s] t) + D'gk{s) + RgU*. 

In [B], an equilibrium control was constructed through the solution of the following 
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system of ODEs (where we suppress subscripts s for notational simplicity): 

0 = M+{2A+\C\^)M+ Q 
(4.3) -M{B'+ C'D){R +MD'D)-\M - N+ MD'C], s 


(4.5) 


Mt = G; 


0 = iV + 2AN 


(4-4) -NB'{R +MD'D)-^[{M - N-T^^'>)B + MD'C], s e[0,T], 


NT = h- 

f(b = _yir(b, se[0,T], 


p(l) _ 11 . 
It — hi) 


0 = $ + {A - [(M - N)B' + MC'D]{R + MD'D)-^B}^ + (M - N)b 
(4.6) +C'Ma - [{M - N)B' + MC'D]{R +MD'D)-^MD'a, s G [0,T], 

= —h2- 

If this system of equations admits a solution (M, iV, Ed), $), then the feedback control 


law 


(4.7) 


ul = asX* + j3s 


dehnes an equilibrium, where 


a, = -{Rs + MsD'^Ds)-\{Ms - N, - 


(4.8) 


= -{Rs + MsD{Ds)-\^sBs + MsD{as); 


see [HI Theorem 4.4]. Moreover, the existence of solution to (14. 3 1) - (14. 6 h is studied in [6]. 
The next theorem provides that the control constructed above is the only equilibrium. 
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Theorem 4.1 If admits a solution (M, N, 4)), then there is a unique equi¬ 

librium control. 

Proof: Suppose there is another equilibrium state-control pair {X,u). Then, with a 
slight abuse of notation, equation fl3.ip . with X* replaced by X, admits a unique solu¬ 
tion {p{-;t), k{-)) satisfying A(s; s) = Bsp{s;s) -\- D'^k{s) -\- RgUg = 0 for a.e. s G [0,T]. 
Dehne 

Pis; t) := p{s-1) - {MsX, - [X,] - + $,), 

k{s) := k{s) - MsiCsXs + + aj. 

The equilibrium condition for {X, u) yields 

Bs [p(s; s) {Ms — Ns — -|- D{ [fc(s) -|- Ms{CsXs -|- DsUs + <7*)] + Rs^s = 0. 

Since Rg + D{MsDs is invertible, we solve for Ug in the above equation to obtain the 
following expression 


u. 


(4.9) 


= -{Rs + D^MgDg)-^ [Bsp{s; s) + D{k{s) 

+ {Bs{Ms -Ng- ri')) + D{MgCg)Xg + Bg^g + 


On the other hand, we can show that (p(-; t), k{-)) satishes the following BSDE (details are 
relegated to Appendix A): 

(4.10) 

dp{s-1)= - {Ap{s-1) + C'k{s) - [C'MD + MB'] [R + D'MD]-^ [Bp{s- s) + B'k(s)] 

^ +NB'[R + B'MB]-^Et[Bp(s;s) + B'k(s)])ds + k(sydWg, se[f,T], 

p(T;t) = 0, 

\ 


where we suppress the subscript s for A, B,C,B, M, N, R, and we have used the equa¬ 
tions for M, TV, rd),$. Moreover, it is easy to prove that E \k{s)\‘^ds < -1-cxo and 

SUP46[0,r]E [sup,>i \p{s]t)\‘^] < +CX). 

We will prove in the next theorem that equation fId.lOp admits at most one solution in 
the space Ci x C 2 , where 
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and 




, sup E 

te[o,T] 


sup |X(s; t)\" 


S>t 


< +CXO 




^), sup E 
tG[o,r] 


\¥{s;t)\‘^ds 


.Jt 


< +CXO 


Hence p{s;t) = 0 and k{s) = 0. 

Finally, plugging p = k = 0 into fl4.9p . we find that u has exactly the same form of 
feedback control as that of u*] see fl4.7p . This proves that u and u* lead to an identical 
control. Q.E.D. 


It remains to prove the uniqueness of solution for fl4.10l) . Indeed we will do it for a 
more general equation 


dp{s;t) ^ -f {s,p{s;t),p(s] s),Ef [/i(s)p(s;s)] [/ 2 (s)fc(s;i)]) ds 


(4.11) 


+k{s;tydWs, se[f,T], 


p{T;t)= 0, 


where li and I 2 are two essentially bounded, adapted vector processes with suitable dimen¬ 
sions, and f{s, .) is a deterministic function satisfying uniform Lipschitz condition in 

all variables except s. 


Theorem 4.2 Equation admits at most one solution {p,k) in the space £1 x £ 2 - 


Proof: Suppose there are two solutions {p^^\k^^'>) and {p^‘^\ k^'^'>) in the space £1 x £ 2 . 
Define p(s; t) = p^^^s] t) — p^‘^\s] t), k{s] t) = k^^^s] t) — k^‘^'>{s] t) and 


A/(s;t) = f{s,p^^\s;t),p^^\s;s),Et s)] ,k^^\s;t),Et [l 2 is)k^^\s;t)]) 

-f{s,p^‘^\s;t),p^‘^\s;s),Et s)] ,k^‘^\s;t),Et [l 2 {s)¥^\s;t)]). 

Then |A/(s;t)| < ci (|p(s; t)||fc(s; f)|-t-|p(s; s)|-f Ej [|p(s; s)|]-h E* [|fc(s;t)|]) for some 
constant Ci, and 


dp{s; t) = — A/(s; t)dt + k{s; tydWg, p{T;t) = 0. 
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For any t G [0,T], s G [t,T], by Ito’s formula, we have 


|p(s;f)|^+ / \k{u;t)\‘^du = 2 / p{u;t)Af(u;t)du — 2 / p{u]t)k{u]t)'dWu 


Thus 


E[|p(5;t)|2] +E 


\k{u] t)\^du 


< ciE 


< C2E 


\p{u]t) \ {\p{u-,t) \ + \k{u-,t) \ + \p{u-,u)\+Et [\p{u-,u)\] + Et [\k{u-,t)\]) du 


{\p{u]t)\^ + \p{u]u)\^) du 


+ -E 
2 


\k{u; t)\‘^du 


s 

where we have used the inequality cxy < for any nonnegative c, x, y. Conse¬ 

quently, there exists C 3 > 0 such that 


(4.12) E[|p(s;t)p] +E 


|/c(m; t)\'^du 


< C 3 E 


(|p(M;t)P + b(M;M)P) du 


Furthermore, for any s G [t,T], we have 


E 


\p{s;t)\‘^ + / \k{u;t)\‘^du 


sup E [|p(m; -|- sup E[|p(m;m)P] 

u€[t,T] ue[t,T] 


< c^{T -1) 

< 2cz{T-t) sup E [|p(s;m)|^] . 


t<U<S<T 


Hence 

(4,13) 


sup E [|p(s;'(()|^] < 2 c 3(T - 1) sup E[|p(s;u)p]. 

t<u<s<T t<u<s<T 


Now take <5 G (0, l/( 4 c 3 )). Then for any t E [T — <5, T], we have 

sup E[|p(s;m)| 2 ] < ^ sup E[|p(s;m)P], 

t<u<s<T ^ t<u<s<T 

which implies supi<„<^<'rE [|p(s;m)P] = 0. It follows that p{s;u) = 0,a.s. almost every¬ 
where in {{s,u) :t<u<s< T}. 

For t e [T — 26,T — 6] and s G [T — <5, T], since p{u, u) = 0 for any u G [s, T], we have 
by fl4.12p that 


(4.14) 


E[\pis;t)\^] +E 


< C3E 


(m; t)\‘^du 


\k{u; t)\'^du 

Grownwall’s inequality then leads to p{s;t) = k{s-,t) = 0. 

For t G [T — 26,T — 6] and s G [t, T —<5], noting p(T —5; t) = 0, we can apply the previous 
argument for the region t G [T — 6,T] and s G [t, T] to deduce that p(s; t) = k{s; t) = 0. 

We can then repeat the same analysis in a backward manner to t G [T — 35, T — 26] 
and so on until we reach time t = 0. Q.E.D. 
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5 Uniqueness of Mean-Variance Equilibrium Strate¬ 
gies in A Complete Market with Random Parame¬ 
ters 


Following mj, as an application of the time-inconsistent LQ theory, we study the continuous¬ 
time Markowitz mean-variance portfolio selection model in a complete market with random 
model coefficients. We aim to establish the uniqueness of the equilibrium strategy. The 
model is mathematically a special case of the general LQ problem formulated earlier in this 
paper, with n = 1 naturally. However, since some coefficients are allowed to be random, 
the uniqueness result of the previous section is not applicable here. 

We use the same setup of [6]. The wealth equation is governed by the SDE 


(5.1) 


dXs = TgXgds -|- O'gUgds -|- u'gdWsi s G [f, T], 

< 

Xt = xt, 


where r is the (bounded) deterministic interest rate function, and 6 is the essentially 
bounded stochastic risk premium process. 

The objective at time t with state Xt = Xt is to minimize 

(5.2) J{t,xt]u) = ^Vart(XT) - (/iiXt-F/i2)Et[^T] 

= ^ [M^t] - (EtM)') - (/ilXt + P2)Et[XT] 


with pi > 0. As noted in [6], there are two sources of time-inconsistency in this model, 
one from the variance term and the other from the state-dependent tradeoff between the 
mean and the variance. 

In [H Section 5], we constructed an equilibrium through the solutions (M, f/), (T^), 
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(rM,7®), and (rW,7P>) to BSDEs: 


(5.3) 


where 


dM, = -[2rsM, + {e,M, + U,yas]ds + U'dWs, = 1 , 

rfrf = -[r,rf + + Usy(3s]ds + (7F^)'rfhh„ 4') = -fi2, 

rfr® = -[r,rf+ (0.M, + ?7,)'/3,]rf5 + (7f))W„ 4^ = 0, 


(5.4) 


«, = -M-^ + Us- 7^'^) , 


/9s = -M, 


-1 


0,(4^-rf) + 7® 


In this case, the BSDE (13.11) for p{-]t) corresponding to a given strategy (control) u* 
with the wealth (state) process X* specializes to 


(5.5) 


dp{s-, t) = —rsp{s] t)ds + k{sydWs, 

p{T- t) = X^- Et[X^] - piX; - p2, 
and the corresponding A(s;t) is 


A(s; t) = p{s; t)6s + k{s). 

It is proved in P, Proposition 5.1] that the system of BSDEs (15.31) admits a unique 
solution with both M and M~^ being hounded, and U-W a BMO martingale. Furthermore, 
the feedback strategy 


(5.6) ul = a,X: + 13s 

dehnes a control in the space Lj'(O) 9^5 ®'^)) which is an equilibrium strategy for the mean- 
variance investment problem. 

We now claim that the equilibrium above is unique. 

For any g > 1, dehne 

CM ■■= {^(s •) : ^(s t) e 4(D; C{t, T; M)) Vf G [0, T]} , 
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and 

£ 4 ( 5 ) ;= <|^(-) : Y is adapted and E 

Theorem 5.1 There is a unique equilibrium strategy for the mean-variance problem l[5.1\) - 
h5.2^) . which is identical to the one generated from the feedback law H5.6\) . 


fT \ 'j/2' 

|2 


\Y{s)\^ds 


< +CX0 


Proof: Suppose there is another equilibrium wealth-strategy pair {X,u). Then equation 
fl5.5p . with X* replaced by X, admits a unique solution (p(-; t), fc(-)) satisfying A(s;s) = 
p(s; s)6s + k{s) = 0 for a.e. s G [0, T]. 

It is proved in [H] that and F^^^ are all bounded, and 7 *^^^ • W and 

U ■ W are both BMO martingales. In particular, since U ■ W is a. BMO martingale, it 
follows from the John-Nirenberg inequality (see Kazamaki [5l Theorem 2.2, p.29]) that 


there exists e > 0 such that E 

g > 0. 

Dehne 


e^fo 


< +CX 0 . Thus E 


Wds 


< +CX 0 for any 


p{s;t) :=p{s;t) 


M,Xs + Fi') - E {MsXs + Fi"^) - Fi'^Xi 


k{s) = k{s) - {MsUs + UsXs + 7 ?^ j . 


It is easy to check that p G ^ 3 ( 2 ). On the other hand, k G L3r(0, T; Mn + 7 ^^^ G 
L3r(0,T;M'^), and for any q G (1,2), 



■ / /.T N <]X 


/ .T xVS- 

E 

/ \U,X,\^ds] 

VI 

sup \Xs\U / \Us\'^ds] 


\Jo J 


se[o,r] \Jo / 


/ 


y /2 / 

■/ i>T 

E 

sup 

E 


V 

sG[0,T] 

J V 

\Jo J 


< +CX0. 


1-5/2 


These, together with the fact that L3r(0,T;R‘^) C Ci{q) Vg G (1,2), imply k G ^(g) for 

gG (1,2). 

Furthermore, the equivalent condition gives 

p{s; s)9, + k{s) + 0 ,[Ff) - Ff) - F«X,] + + 7 ( 2 )] = 0 . 
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Solving for Ug we obtain 


Ug = -M, 


-1 


(5,7) 


{u, - A', + g,p(s-, s) + k(s) + - rr’) + 7, 


(2) p(3)x , ^(2)' 


= agXg + I3g- [OsP{s-, s) + /c(s)]. 


Next, we can derive the following BSDE that (p(-; t),/c(-)) satishes (details are placed 
in Appendix B) 


dp{s; t) = - {rgp(s-, t) - {9g + UgM^ ^)'[6'sP(s; s) + /c(s)] 


(5.8) 


+Ei [(0, + UgM-^y[egp{s; s) + fc(s)]] } ds + k{sydWg, s e [t, T], 


p{T]t)= 0. 


We will prove in the next theorem that this eqnation admits at most one solntion (p, k) 
in the space x / 14 (g) for some q G (1, 2), leading to p = 0 and k = 0. Consequently, 

we have Ug = agXg + (3g. In other words, Ug has exactly the same feedback form as n*. 
This establishes the uniqueness. Q.E.D. 


Theorem 5.2 For any q G (1,2), equation 15.51) admits at most one solution {p,k) G 
A(?) X C^iq). 


Proof: Fix t. Taking E* [•] on both sides of the integral form of (I5.8jl and noticing that 
k ■ W is a martingale, we get 


Et [p(s; t)] = / r^Et [p(z/; t)] do, 


which implies E^ [p(s; t)] = 0 for any s > t. In particular, taking s = t, we have p{t] t) = 0. 

Hence equation fl5.8p reduces to 

(5.9) 

dp{s-, t) = - {rgp{s-, t) - {6g + UgMp^yk{s) + E^ [(^^ + UgMp^y^s)] } ds + fc(s)'dHA, 

< 

p{T]t) = 0. 


As r is deterministic and bounded, we can discount p(s; t) by e to remove the 

term —rsp{s] t) on the right hand side of the above equation; thus henceforth we assume 


20 











r = 0 without loss of generality. Define p{s]t) := p{s]t) — [{6^ + ^)'/c(n)] dv. 

Then p{T]t) = 0 and 

dp{s] t) = {6s + UsM~^)'k{s)ds + k{s)'dWs. 


For any q G (1,^), denote q = q/q, and l/p + 1/q = 1. Then 


E 

< E 

< CqE 

< ciE 


sup 

sG[i,T] 


/ Ei {0, + U,Mp^)'k{u 

J s *■ 

{6^ + U^Mp^y k{u) dv 
\d'Jk{v) \dv 


dv 


+ CqE 

([\pyuik{v)\dvy 


\jt j 


rT _ \ 9/2' 

\k (v) \‘^dvj 


< C3 + C2 I E 

< + 00 , 


lU.l^dv'] 


+ C 2 E 

qpl2' 




9/2 / f-T \ 9 / 2 ' 

\k{v)\‘^dvj 


i/p 


E 


\k{v)\‘^dv'\ 


<?/ 2 ' 


1 /g 


where cq, ci, C 2 and C 3 are proper constants. On the other hand, it is assumed that p G C 3 {q). 
So it follows that E [sup^gj^ j^] |p(s;f)|^'] < +CX). 

Dehne ^ = £{-{9s+UsMp^)-W)t = e-^o \d.+UsMr^\^ds-jp{d,+UsMrp'dWs_ UM-^- 

VF is a BMO martingale, E [,^] = 1; so it can be used to dehne a new probability measure 
Q by ^ under which Ws = Wg + Jq(6v + U.uMp^)dv is a standard Brownian motion. 
Furthermore, 

dp{s]t) = k{sydWs, p{T-,t) = 0. 

Applying Ito’s formula, we obtain 


Hence 


dM-^ = 


-Mp^dMs + 


= M. 


-1 


hi) 


Us 


M 




M. 


Ms 


U' 

ds - ^-dWs 

Ms 


Mp^ exp 


U'sds 

Ms 


p{i) 


\0s? , i\u 


Ms 


+ X 


2 M2 




M2 


r u' 

ds - / -^dW. 

Jo Ms ^ 
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Comparing ^ and we deduce 


^Mt = Mq exp 






It is clear that Mqc is bounded, and e 2 /o \^s\^ds e'^dWs ^ j^g ^qj, g > x_ 

Moreover, for any g > 1 and any e: > 0, there exists a constant C > 0 such that 


)1 

< CE 

\Us\'^ds 

/ 


- 


E 


We have shown previously that there exists e > 0 such that E 

fTr(l) Ss U: 


gs/o \Us\'^ds 


< +CX 0 . There- 


rr' (^Q ~ ”1 

fore e~ ® g This in turn proves ^Mt € L‘^. However, M~^ is bounded, so 

^ E for any g > 1. 

Now for any g G (1, g) and g G (1, g), we have 


sup |p(s;t)|''] = E 

sG[t,T] 


sup |p(s;f)|^^ 

sG[t,T] 


< 

< +CO, 


sup |p(s;f)|‘' 

sG[t,T] 


Q/<i 


(E 


ig-q)lq 


which implies that p{-]t) is a Q-martingale, and hence p = 0 and k = 0. Since p{s]t) = 
p{s-, t) + + UyM~^yk{v)] dv, we conclude p = 0. 

Q.E.D. 


6 Concluding Remarks 

Equilibrium control is an alternative and weak notion of solution to a dynamic control 
problem when the traditional time-consistency is absent. The uniqueness results we estab¬ 
lish in this paper (if only for some special cases) justify, from an important aspect, not 
only the game formulation for the time-inconsistent dynamic decision making, but also our 
dehnition of equilibria over the set of open-loop (instead of feedback) controls. They also 
shed a light on the search of conditions for uniqueness of more general problems. 

Since equilibria are dehned via local perturbation for the game formulation, unlike the 
optimal solution for a time-consistent problem, they do not inherently lead to the same 


dsdWs 
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value process. The uniqueness of the solution does indeed imply the uniqueness of the 
value process, which in turn addresses concerns such as “why an equilibrium is dehned this 
way”, or “which one to choose if there are multiple solutions”. 

We realize that in this paper the uniqueness has been established only for some special 
classes of the LQ control problem. For general time-inconsistent LQ or even non-LQ 
problems, existence and uniqueness of equilibria remain outstanding research problems. 
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A Derivation of (14.10 1) 


We write fl4.9p as Ug = otgXg + /S* + W where Vg := —{Rg + MsD'^Dg) ^[Bgp{s-, s) + D'^k{s)] 
and ag and 13s are given by fl4.8p . The equations for M, iV, $ can be rewritten as 


(A.l) 0 = M + (2A+|C'nM + g + M(5' + C"T))a, s e [0,T], Mt = G; 

(A.2) 0 = iV + 2AiV + iV5'a, s e [0,T], Nt = h] 

(A.3) = -ATW, s e [0,T], = /ii; 


(A.4) 


0 = $ + A<h + [(M - N)B' + MC'D]I3 + (M - N)h + CM a, s e [0, T], 

< 


Hence (the subscript s is suppressed) 


d{MX) = [M{AX + B'u + h)-XQ- XM{2A + + {B' + CD)a)]ds 

+M{CX + Du + a)'dWg 

= [M{B'P + B'V + h)-XQ- XM{A - B'a + + {B' + CD)a)] ds 

+M{CX + Du + aydWg 

= [M{B'^ + B'V + b)-XQ- XM{A + + C'Da)] ds 

+M{CX + Du + aydWg. 


Similarly, 

d{NEt [X,]) = [NEt [AX + B'u + b]- N{2A + B'a)Et [Xg]]ds 

= [N{B'^ + B'Et [K] +b)- N{A - B'a + B'a)Et [Xg]]ds 
= [X(H'/3 + B'Et [1^] +b)- NAEt [X,]]ds; 
d(rWXt) = -AT^Xids. 


So 


d{MX - XEt [X,] - r^^^Xi + $) = C^^^ds + iC^^^ydWg 
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where = M{CX + Du + a) and 


((1) = M{B'P + B'V + b)-XQ- XM{A + + C'Da) 

-N{B'(3 + B'¥.t [I"] + 6) + NAEt [X,] 

-A^ - [{M - N)B' + MC'D](] - (M - N)b - C'Ma 
= [-Q-M{A + C^ + C'Da)]X +NAEt[Xs] + 

+ {MB'V - NB% [K]) - - MC\DP + a). 

However, p{s; t) = p(s; t) — [MgXg — NgEt [X^] — ri^^X^ + $s], we deduce 
dp = dp-C^^'>ds-{C^^^ydWs 

= -[Agp{s; t) + C% + QgXg + Ci'^]ds + % - C^‘^^]'dWg 
= Cf'^ds + k'gdWs, 

where 

= -H,[p(s;t)-MX + XEi[X,]+r«X 4 -$] 

-C'g{kg - CMX - MDaX - MD^ - Ma) 

-{MB'V - NB'Et [K]) 

= -AgPis] t) - C% - C'MDV - {MB'V - NB% [K]) 
= -AsPis] t) - C'ks - {C'MD + MB')V + XH'E^ [H,]). 

This proves fl4.10l) . 


B Derivation of (l5.8l) 


We write fl5.7p as Ug = cXgXg + + Vg, where Vg := —Mp^[9gp{s; s) + fc(s)] and ag and (3g 

are given by (15.41) . 

Making use of (15.3p . we can compute 

d[MX] = [M{rX + e’u)-X{2rM+{Me + Uya) + u'U]ds+[Mu + XU]’dWg 
= [-rMX + {9M + Uy{P + V)]ds + [Mu + XU]’dWg-, 
dEi[MX] = Et[-rMX+ {9M+ Uy{P+ V)]ds-, 
dVy^Xt = -rVy^Xtds, 
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where we have used the fact that 7 *-^^ = 0, which can be seen from the BSDE for Fd). 
Since 

p(s;f) =p(s;f)-M,X,-r(2)+Ei [M,X, + Ff)]+1^X4, k{s) = k{s)-M,u,-XMs-'yi^\ 

we derive dp{s]t) = (s'^'^ds + (C*'^^)s'^hF 5 , where = k{s) — [MgUs + Xglls + 7 *-^^], and 

((4) = -rp{s; t) - [-rMX + {OM + U)\P + V)] + [rF^^) + {QM + f/)'/3] 

+¥.t[-rMX+ {eM+ U)\P + V)] - E* [rF^^^ + ( 0 M + - rF^X* 

= -r[p{s; t) - MX - F^^^ + E^ [MX + F^^^] + 

-{OM + U)'V + Et [{OM + uyv] 

= -rp{s-, t) - {OM + uyv + Ej [{OM + uyv]. 

This proves fIS.Sp . 
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